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The study that forms the backbone of jthis paper involves using cognitive 
developmental measures and other measures of functional ability in conjunction 
with traditional varic\l)les in a regression analysis against student performance 
on a newly developed science curriculum. Seven replications of this study are 
reported. 

TliG concerns underlying the paper go far beyond the study reported. They 

address the following questions: 

1. llow informative are IQ scores to teachers of EMII children? 

--Our investigations thus far suggest that they are not only 
uninformative but unrolieible, and hence, misleading. They 
neither identify a child's learning problems nor do tliey 
identify which children are more able to co]:e with specific 
classroom requirements. Thus, IQ scores do not realistically 
enable a teacher to prescribe remedies and form sound educa- 
tional expectations for the Individual student. 

2* Do IQ scores at least identify v/ho v/i 11 l^e the slowest to learn or 
will have the least potential for succeeding? 

--In terms of tlie series of studies reported here, IQ scores 
are neither predictive nor explanatory of variance in perfor- 
mance on the science materials as measured. 

3. Can any educationally useful measures be found that do explain variance 
in- performance? 

— Several meaningful measures of al^ility are reported herein, 

4. Can teachers use this information? (Does the information make any 
difference in teacher's behavior towards children and is it useful 

in deciding what children should study or influencing their success?) 

--A definitive answer can't yet be given. This is an area of 
continuing study. 

5. How does subject matter and type of performance assessed affect the 
meaningfulness of the measures we have idojitified? 

— Tliis is not yet known. Others nee<1 to utilize these measures. 
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The major issue to which all these questions re3,ate is this: Is grouping of 
ahildx'on into special classes pvimax^ity on the basis of IQ scores educationally 
defensible? 

— The answer v;e got from a variety of studies is no, it is not. 

The present study tells us that for our materials and assessments, IQ is not 
a relevant variable. A previous: study indicated that the appropriate placement 
of 42% of the population in 35 field test classes could be questioned. Over 40% 
of the IQ scores were four or more years out of date, many having been obtained 
when those 13-16 year-olds were eight years old or younger. {IQ scores were 
'updated for ttie studies rep<.irted.) An additional concern is that EMM children 
tend to remain in special classes. Other concerns include the sticma associated 
with such placement, the widening gap between what is taught in n^gular and special 
classes over the yeari^, the Pygmalion effect suggested by Rosenthal, the concerns 
about labeling raised by Mercer, and DeAvila and Uavassy's notes on the cultural 
limitation of IQ tests. These all add ''uol to the argument that IQ as a basis of 
labeling and grouping EMH children is net educationally defensible. The benefits 
do not. justify the high cost in time and money required for IQ testing. 

What then is an alternative to IQ grouping of children? The problem the 
teacher faces ;n any classroom, buc critically in the special education class, is 
to discover what each child's levol of functioning at a given time actually is. 
Only then can :he learning materials be mediated to accommodate the level and rate 
of functioning of each child. Note that functional cibility Im assumed to change 
as a child develops and to be specific to the kind of task rather than a global 
measure. The intent of assessments of functional ability is to identify present 
capabilities. Unfortunately, actual tests of functional ability do not exist. A 
few are currently being developed. Little is known of the relationship of variour. 
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cibilitios to instructional matoricvls in any discipline. It behooves each curriculum 
developer to explore the eibilities judged uniquely requisite for success on specific 
materials and to provide the teacher with tools to make the success possible, for^ 
each student. 

The purix)se of the BSCS in studying sc;ience for children in special education 

(J 

classes is to pioneer a curricuUow for doers rather than scholars. Readirg, 
writing, and aritluuetic are not the central features of tliis program. Instead, 
students do activities and experienc^^ situations to gain a practical understanding 
of the world around them. The materials are intended to be both functional and 
intellectually stimulating, but in the special education setting this means 
callinc,. upon a difftirent set of skills. What are these skills for the doers, that 
will enable them to cop<5 with practical problems and situation^T in and out of 
school? What abilities influence the acquisiti(m of competence in various tasks? 
And at what levels of functioning are the children in special classes? 

Piaget's theory of cognitive-, development seems to offer one alternative to 
the use of IQ' scores as a meaningful way to make judgn.ents about what is appro- 
priate for presentation to children and what are appropriate expectations of 
children at differing levels of development. The orientation provided by a 
cognitive devc^.lopmental approach is completely diffcirent from the traditional 
approach. First of all, expectations of children are based on what they have 
done and are capable of doing rath'ir than on what others of their age or IQ 
level can do. Criteria for successful performance are also ba^ed on an under- 
standing of what is associated and appropriate for each developmental level 
rather than comparison with other children. Retar^dation is redefined in terms 
of developir.ental level and rate. 

A 'developmental th<;ory would also offer conijiderable guidance in the design 
of curr.Tcula. The child is considered to be an active organizer of information 
who usf^s a different process of reasoning at each stage of development. The 
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curricula and teacher v.ould deal with the experiences i.hat best provide direction 
and guidancri in organiz.uig the world, rather than siiaply bits and pieces ot* itjfor- 
mation judged to be needed by an adult, 

Application of a cognitive develoi:/mental theory does not necessarily mean 
identifying and grouping children by developmental level. It does require that 
developmental Jevel be assessed. The questions addressed in this paper are 
whether r>uch an assessmen". can he accomplished economically an<3 whether it can 
explain variance in performance of childrtm. The answer to these questions is 
yes. Other studies not re^.orted here support the validii.y of this assessment 
procedure. (Steele; Gray 1973b ) 

At this point Ittt us shift to a description of the study and its results 
aiid then consider their implications. 

METHOD 

Context ard Subjects 

This s'-udy arises in the context of the development and evaluation of ME 
AND MY EIW.IRONMEIJT, a three-year lif^ sciences p::ogram dovoloped specifically 
for 13- to 16-year-olrj educable mt;ntally h^'indicapped (EMH) children. One group 

r 

of 14 classes (FTl) began field testing these materials in 1971-72. A seconil 
finld tes' group of 21 ftla^ses (B'T2) began tec?ting revised materials in 1972-73, 
Table 1 provides dem^^graphic dal a for the 592 students in field tests 1 and 2* 
Aln^ost all the children were betwe^sn the ages of 12 to lb. Moan IQ for FTl and 
FT2 wore 67 and 68 respectively. 

As performance r«easures weie adminstered at difl'erent tr.m'js and as not all 
clasf:e,'i completed all sequenc es of instruction, samf;le sizes vary for each an/^lysis. 
For the 2 971-72 studies, 109 studenti^ (70% of samplf) in 10 clar^sos were included 
in the analysis. In tlie 1972'-73 studies the following r^amples wer*; usr^d: 



ERLC 



Field Tost 1 



Field Test 2 



# Classes 

# Students 

% of Jan. 1973 
enrollment in 
these classes 

% of total Scunple 



Unit 

2 

12 
112 

67% 
5U% 



Unit «1 Unit 4 

Subtest 1 SuJ-test 2 



11 

101 

63% 
52% 



6 

58 

66% 
30% 



Unit 1 
S ul'>test 1 

14 

144 



63% 
48% 



Unit 1 
Subtest 2 

15 

143 



61% 
48% 



Unit 
»> 

16 
180 

73% 
60% 



Instrurnents 

The following instruments were developed for use in these studies: 

1» Cognitive Development/Problem Solving (CD/PS) Tost of Developmental 
Level 

2. Teacher Ratings of Students 

3. Student Performance measures for Units 1, 2, and 4. 

The CD/PS test and three-fourths of the student performance measures con- 
sisted of paper and pencil multiple-choice items. Most items included drawings 
for concrete reference. Table 2 provides examples of the type of items used. {For 
information on the development of these items, see Steele, 1973.) Twenty-five 
X^orcent of the perfonaance measures were actual ratings of performance on 
situational tasks. 

The CD/PS ti'St consisted of twelve cognitive development (CD) and eight, problem 
solving (PS) items. The CD items reflected the logic of a specific developmi-ntal 
level and were derived from previous work by Gray (1973). The PS Items assessed 
four problem solving skills r<-!lated to experiment:^. An e>c post facto analysis of 
the logic of the PS iter^s indicated they wer«^ all concrete operational exclusion 
type problems. Because the tvo cognitive development Items of \ exclusion tyy-e 
required similar kind of inferential reasoning and seemed to require a similar 
problem solving skill, tliey were grouped vith t\vO of the problem solving items for 
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the analysis. Table 2 illustrates the distribut ion of type and Invel of, items 

in the CD/PS ti^st. This inslrumont has been analyzed u.sing ordering theory (Bart 19/3), 

a measurement model that caii a'^sess all multilinear prerequisite relationships 

within a se*. of data (Cray, 1974,) This analysis provides subs^■an^,ial support 

for tho differentiation between concrete and fomal levels of cognitive d»-velcp- 

ment and for tlie relationships witliin the various itom types. The relationships 

within skill types of problem nolving items were minimal. An^ilyzed as a total 

teot, logical prerequisites were clearly s)iown to exist among all items* Tables 

4 -and 5 grai-hical ly show these relationships and provide descriptions and statistics 

ftir the four subtr^^ts derived from the CD/PS test. 

The teacher Ratings of Students were based on criteria which initially were 
judged likely to contribute to successful performance of the science activities. 
These included: 

1- Ability to follow directions. 

2. Ability to work with a group. 

3. Ability to work with hands. 

4. Child's awareness of what is going on around him. 

5. Child's attitude and approach to school. 

6. Primary reason for child's placement in the class. 

Table 6 shows the definitions for each category which wex'e provided to 
teachers and lists the distJ ibution of ratings given. 

The Student Performance measures consisted of twenty-five multiple-choice test 
item?., eight ia'-.ks requiring interpretation of pictur«rs, and eight situational 
tasks resulting in teacher ratings of performance. The iteip.s were all generated 
as indicators of stud'^nt learning in fourteen areas of content. These items were 
grouped into five subtests for purposes of analysis in this study. Tables 7 and 8 
provide descriptions and statistics related to these tests. 

O 
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In addition to the measures described, current WISC total IQ scores (or 
Wise equivalents), data on student age, sex, and ethnic background wore provided 
by the schools involved. 

Procedure 

All student tests were administered by the classroom teacher. For the CD/PS 
Test, each student received a copy and responded to four practice items before 
answering the twenty qu^sstions. The teacher read each question and responded 
aloud twice and checked to see that students were on the correct pa.ie. Item 1, 
a conservation of liquid quantity item, was demonstrated by the teacher before 
students made their response. (For a study of the validity of this procedure, see 
Steele, 1973a.) This instrument was given in late spring and required one class 
period (4O-'50 minutes) to administer. 

The student performance items were adminstered at nine intervals through- 
out the year as students reached appropriate points in the curriculum. Paper and 
pencil items were printed on student worksheets and administered in a manner 
similar to the CD/PS Test. Absences and turnover rate contributed to reduce the 
sample for which complete performance data was obtained. 

Analysis 

Each of the ten subtests assessing student ability or performance was analyzed 
using an item analysis program. Results of this study are showii in Tables 4-3. 
These tables also present the biserial correlations of items with total subtest 
scores to illustrate the homogeneity of items grouped as subtests. The data were 
then converted to a binary system and analyzed using the Biomed BMD02R step-wisr? 
multiple regression program. Seventeen variables were entered into each regression 
analysis, including the measure of performance, the four CD/PS subtests, the six 
teacher ratings, the four demographic variables, the particular test class, and 



student absence rate during the year, As there were six separate subtests of 
student performance derived in 1972-73 (three for each field test group), six 
regression studies were perforried. In addition two regression studies had been 
conducted o:\ student performance data for field tost 1 for the 1971-72 school 
year including most of the variables (with the exception of a reduced r.umbrrr of 
CD items). Thus, thi« paper reports on seven replication studies of the (fuestions 
under investigation. 

In «:^rder to avoid misinterpreting the results, a seco.n.d regression «inalysis 
was conducted on each of the eight studies forcimj IQ to enter the equation first 
rather Mian allowing the strongest variable to entisr. This was done because the 
nature of this statistic is such that when two measures of the same thing arr: 
included, all of l.he v^'.riance will be attributed to the variable entering the 
equation first. The variance will not be split between the two measures. On 
the possibility that total IQ could be closely related to measures of cognil-ive 
development and/or problem solving, it was entered first in the second regression 
analysis. 

Finally, a^ the reliability of two of the CD/PS subtests was quil'.f: low 
the total CD/PS Test scores (r = .73, .7P.) were used in place of the subtests for 
the 1972-73 data, and six regression analyses and their associated forced IQ 
analyses were conducted. Thus the results of a total of 28 regression analyses 
are reported in thi.*^^ pacer. 
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RESULTS 

Tables 9-18 sununaVize the results of the regression analyses by f Aeld 
test group for variables with F values significant beyond the .01 level of 
confidence. 

What happens when IQ is forced to enter firsL in the regression equation? 
Inspecting Tables 10, 12, and 14/ it can be noted that IQ explains a significant 
portion of the variance in six of the eight cases. However, in only two cases is 
the amount of variance explained larger than the additional variance explained 
by CD/PS variables after IQ has entered. Fven in those two cases the additional . 
variance explciined by CD/PS variables is within 1-2% of the variance explained by 
IQ. Tables 9 and 10 can be used to discuss what Im occurring, as the same condition 
holds for all of the other pairs of tables. In Unit I, the Problem Solving subtest 
entering first accounts for 37i of th*j explained variance, IQ entering first 
accounts for 17% of the variance with Problem Solving contributing an additional 22% 
of explained variance. The two tests were related, but not closely. The 
correlation of IQ with Problem Solving in this study was ,47, Consider«*-,d 
independently, the correlation of IQ with Performance was .41 compared with a corre- 
lation of .61 for Problem Solving with Pnrformance. The interrelations of IQ, 
Problem Solving, and Performance on Unit I might be illustrated graphically as 
fo.l lows; 
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Shaded areas indicate variance in performance accounted for by the two measures. 
Problem Golving accounts for nosl* of th<i variance in performance explained by lo, 
but contributes a large amount of explanation not providecl by IQ* Hence, the results 
of i.he first ri^grer3sio;» analyses, (Tables 9, 11, .13, 15, and IV) are tho appropriate 
results ^:o interpret in this study. 

What follows from this conclusion combined with the results of Gray^s (1974) 
analysis of prerequisite relationships in the CD/PS Test and Steele's (1974a) «tudy 
of the validity of the items, is that it is, indeed, possible to measure levels of 
cognitive developmn^nt. Such measures ar«i distinct from IQ. They are economical 
because they can be adu-inistered to groups in paper and pencil fomat in^ a short 
amount of time. 

The noxt question io nwiew is that of thf^ exijlanalory power of IQ oji the 
performance of children ';sing this science curriculum, A comparison of the Tables 
9, 11, and 13, in vhirh the str*.*ngest variable was allowed to ont<}r the regression 
equation f\rt\t reveals tliat in only two out of -ight case^? is IQ a significant 
varirible at all, and oi thr^se, in only on"V case was the percent of explained variance 
of aiiy magnitude. Here it contributed an additional 13% to the 25% of variance 
explained by CD/'PS variables. Looking further at the result.s for demographic 
variables ^on Tables 9, 11, and 13, it can be seen that stude?»ts' performance as 
measured on these iencn materials, did not depend on age or fiex or ethnic backgrouml. 
With the one case: excnpt.ion for IQ, these variables do not api>ear to br^ relevan^^, to 
success, at least on th«i HE AKD MY ENVIRONMENT materials. 

What is the relevance of the CD/PS subtt^.^ts to performance on Ihese ricience 
natorials? In six out of oight cases, one or more of tliese subtests explained a 
major porMon of the total variance explained. In three of thw casrs, the problem 
solving subter.l's, primarily PS 1, v;ere th<5 most p.^werful explainers. In two other 
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cases I the Soriation/ConsfM'vation subtest was the i3tron<jest variable! • This 
sugoests that the al'ilit:ior> required to succeed in these science activities are 
to some degree related i:o cognitive level of develop:uont< This point will 
returned to la tor « 

There was one other major source of explained variance in these eight 
studies. The teacher rating of Ability to Follow Directions was a strong ccntri- 
butor to explained variance in five cases* In three cases it represented the 
strongest variable. In addition to Following Directions, the teacher ratings of 
Ability to Work with Hands accounted for a moderate amount (6-7%) of explained 
variance in two cases ♦ Awareness and Reason for Special Placement accounted for 
6-7% of the variance in one case each. 

The patterns in which these variables occurred are interesting to examine, 
PS 1 proved to be the strongest variable in explaining performance on Unit I for 
both field test groups. It nay be that content a} d the nature of the items 
assessing performance were factorn in this outcome. Co:i>tent ar.d the performance 
items again appear to be factors wnich may account for Following Directions being 
a strong variable. In two out of the three cases where it explained the greatest 
amount of variance, the performance items were almost all situational tasks 
rather than multiple choice problem::^. For Unit I, Subtes' 2, the tasks' involved 
actually taking measurements, grouping things or indicating compass or left-right 
directions* For Unit 4, Subtest 1, the tasks involved grouping or order in^j things 
or interpreting pictures, 

A, discrepancy in the use of content and typo of performance item to explain 
differences in result occurs in Unit 2. This Unit is one for which common measures 
are available for both field test groups. For FTl , Seriation/Conservation and 
IQ explained 36% of the Vi^ria? ce. For FT2, Follov;ing Directions and Problem 



ERLC 



11 



Solving tsxplained 32% of the variance, WlUle ono might arguo that difforences in 
the two field test groups must account for such a result, the leek of consistency 
is disconcerting and raises questions about the reliability of the instruinents . 

Looking at tl;e subtests from this perspective, Formal Operations affords 
the least amount of explanation in the six studies in which it was used. It 
accounted for only 2-3% of additional explained variajice. It should be remembered, 
however, that the difficulty of these four items ranged from 8-37% and the subtest 
reliability was .01 and .38. A similar situation holds true for the PS 2 subtest, 
which accounted for 4-9% of the variance in two of the six studies in which it 
was used. Item difficulties ranged from 53*-72i and the relial)ility of this subtest 
was .37 and .30 in the two groups. This raises some question as to the appro- 
priateness of treating these items as separate subtests. 

What patterns of relationships exists when a total test score is derived for 
the CD/PS Test, rather than the four subtest scores? The reliability of the total 
test is .73 and .72 for field tests 1 and 2 respectively. Tables 15-18 summarize 
the results for the six cases. Again IQ is forced out first in ono series of 
analyses (Tables 16 and 18) but the previous support for the first analysis still 
obtains. The CD/PS Test is the strongest variable in five out of the six cases, 
explaining from 19-24% of the variance. Following Directions is the strongest 
variable in the sixth case, and the second strongest variable in four of the five 
other cases. The case in which it is the stronges- remains Unit 1, Subtest 2, 
which represents as assessment of ability to apply skills in situational tasks. 
In Unit 2, CD/PS accounts for 24% and 19% of the variance. IQ remains the 
second strongest variable for FTl and Following Directions for FT2 . 

IMPLICATIONS 

A number of implications can be drawn from this series of studies. First 
of all, the consistent finding that IQ, age, sex, and ethnic backgrourid account 

] 12 



1 

for littlo or no explained variance over seven replications supports the 
accumulating evidence from other sources that those variables are not educa- 
tionally defensible* Tho use of IQ scores as a basis for grouping children 
into special EMU classes, least for scioiice instruction^ is highly question- 
able* ^ 

A second implication that seems warranted from these results is that 
measures of cognitive development can be economically obtained. This dimension 
appears to bo a powerful explainer of variance in performance. It would seem 
approx>riate to continue exploring and refining instruments that deal with cog- 
nitive development and levels of functioning. The teacher appears to be a good 
source for sou\e assessments of functioning. 

What are the implications of these studies for grouping? If IQ is an 
inappropriate strategy for grouping childre/a, is grouping by or across develop- 
mental levels any better as an alternative? Before such a strategy can be 
seriously proposed, a number of questions remain to be answered: 

1. What changes in CD/PS abilities occur over time for EMH and normal 
children? 

2. How do the content and type of performance assessed relate to measures 
of developmental level and functional ability? 

3. What explanatory power do these measures have in other subject areas 
or with materials utilizing a different instructional approach? 

4. Will the knowledge of such results make any difference in teachers' 
behavior in working with EMH children? 

5. Can the use of such information suggest activities and experiences 
that will change the pattern of perfoi'maiice or success of students in 
positive directions? 



.13 



6» Will attending to functional abilii.ios and developmental levels of 

(Children and tho associated instructional responses make a difference 
in their lives outside the school context^ i.e., will* such an approach 
l(!ad to more than improved academic performance? 
7« What iiuplications do measures of cognitive development have for 

curriculvua development? 
An iraplication that can be drawn from this list of unanswered questions 
is that it is premature to suggest the substitution of assessment of cognitive 
development (or any other measure) for IQ as a means for grouping or labelling 
children. What is suggested here is the exploration of such strategies. The 
questions listed are investigable and should yield answers. 

Perhaps the measures reported in these studies can serve as the beginning 
of a collection of tools to assess where the child is at a point in time-- 
his level of func^tioning . Perhaps the perspective of a theory grounded in a 
dcvelopmentai psychology will promote the wise pairing of children learning 
tojether and learning fjom experiences appropriate for their level of under- 
standing. Perhaps this is the appropriate grouping strategy for effective 
instruction* 



ERLC 



REFERENCES 

Bart/ W» M. and Krus, D, J, "An Order incj-thooro tic Method to Determine 

Hierarchies Among Items." Educational and Psychological Measurement, 
1973, 33, 291-300. 

Biological Sciences Curriculum Study (BSCS). ME AND MY ENVIROKMENT , Life 

Sciencess A Special Education Program. Boulder, Colo.: B.S.C.S., 1974, 

Biological Sciences Curriculum Study Newsletter 55. ME NOW and ME AND MY 
ENVIRONMENr, Boulder, Colo.: B.S.C.S., April 1974. 

DeAVila, E. A. and Havassy, B. Some Critical Notes on Using IQ Tests for 

Minority Children and a Pla'jetian-based Computerized Information System 
as an Alternative. Paper presented at the 1974 Annual Meeting cf the 
A.E.R.A*, Chicago, April 1974. dL 

Gray, W. M. Development of a Piageticn^-based Written Ter^.t: JK Criterion- 
referenced Approach. Paper presented at the 1973 Annual Meeting of the 
A.E.R.A., New Orleans, February 1973 (a). 

Gray, W. M. Development of a Written Test Based Upon a Model of Piaget . 
Final Report, September 1973 (b) , l-jiiversity of Dayton, Project No. 
2-E--052, Grant No. OEG-5-72-0044 (509) , National Center for Educational 
Research and Development. 

Gray, W. M. The Integrated Cognitive Structure of EMH (Educabie Mentally 

Handicapped) Children. Paper presented at the Fourth opecial Invitational 
Interdisciplinary Seminar on Piagetian Theory, Los Angeles, February 1974. 

Inhelder, B. and Piaget, J. The Growth of Logical Thinking from Childhood to 

Adolescence: An Essa y on the Construction of Formal Operational Structures . 

Mercer, J. Labeling the MGntally Retarded . Berkeley: University of California 
Press, 1973. 

RosenthaJ , R. and Jacobson, L. Pygmalion in the Classroom: Teacher Expectation 
an d Pupils' Intellec: tual Ability . Holt, Rinehart and Winston, 1968. 

Steele, J. M, ^'Assesstnent of Conservatiori in EMH Children." Bouldert B.S.C.S. 
Newsletter 50, Febr\iary 1973, p. 20, 

Steele/ J. M. Arrangin g Fi eld Tests: Characteristics of r>itos and Students . 
Mr; AND MY ENVIRONMENT Formative Evaluation Report 1. Boulder: B.S.C.S., 
June 1973. 

Steele, J. M. Assess i ng Student Abilities and Performance: Year 1 . ME AND MY 
ENVIRONMENT Formative Evaluation Report 2. Boulder: B.S.C.S., December 
1973. 

Steele, J. M. "A Study of the Validity of the Cognitive Development/Problem 
Solving Test." In As sess ing Student Abilities and Performance; Year 2 . 
ME AND MY ENVIRONMENT Formative Evaluation Report 4. (In press.) 



ERLC 



15 



ACKNOWLEDGMENTS 



No study of ME AND MY ENVIRONMENT would have been possible without the 
dedicated assistance of many teachers. The task of instrument development 
and data collection has been shared by the following project staff consultants: 
Thomas E. Allen, Jay E. Anderson, Dorothy S. Curtis, Roy 0. Gromme, Charles 
Robinson, and Nor r is M, Ross, Jr. 

A special acknowledgment is due to William M. Gr.\y for permission to 
adapt items from his test of cognitive levels. Thanks are also due for his 
perseverance in debugging a program for applying ordering theory to test 
analysis and conducting the prerequisite analysis of the CD/PS test. 

Thanks are also due to Herbert Walberg, for his suggestions regarding 
statistical analysis. 



ERLC 



16 



o 



a 



So 



o 



c 

lu 



o 



7> S 



o 

■si 



o 



*~ 't •J' 03 »- r- r ) 1^ rl cr> q 



ooooo oooo< 



3i5 ? 
00 



so 0 
^ JO 



t 

■ c P P 



u 



D D </> ■ 



3 5 CO <^ a 



00 — <N O) *J 



vn o o « ^) 



d 

O fr> f 



O't'-r^O fjntNtNfM tOOCCOQiX^fO 



oooOr--inM kTsr-oo^in r-f^cNOOO fNO^CNr^co 



c <N n ^ CO 



Cm ^ .rv CN »^ i/i in ^- 



IT! - — ^ ^. ^ ^ Q IJ3 'J 1^1 o tn - r? in <N 



Cfj o> CO oo ^t tf) iii « 



o n C) r\ '0 'D iTi 00 ir» n co <i5 'D n ri it in «r ' 



O <£ 1^ fi5 (O (D in o !0 — 03 Ci o n o '^f o 



•-fNOooo »-rNjr'}»*in Of^ocoi*- rsif**>cn^>-rtif?> 
,M rirM(%rw rj.-onr)M c^r-!o5nrt ^v^^^? 



17 



TA13M; 2 

Examplos of Tost Items !irawn From 1971-72 Studies 
{ltor:^s reduced from full page size) 



Cognitive Dovelopmont items similar to items 1/ 3, and 15! 



V 

r£5T lu^t 



»T5 Cr*1 »!•»[« HA'Vf %n vMt» K JT TwAN M 



in i^l 




!K»ri LA'i* '♦I ''U^-'IO If Mi*!"* 10 HCN Hl^Ih 

If m: r,B-.'i. D^n «»1 t' l-'t tMD 0* Thitfl MLt«;l» 



>^ «* »r 'I n »' 
p jt )• J) >4 1' ^* 

trjLr . 



.jO • '* 

■.TTH 11 n }* M 



|(-.| (M(4 1*^0 • 



Problem Solving items similar to items 2 and 18: 



It 



c 

"/if «>< 1 ON v>;» CHOICE . 





1 



nit X ON *'0';f (.K'l^i : , 



j V.iutYc Bern Pf'TiVfi! .] 



frttD fme s^: i:M siir: ^i,] 



[ j4i ',i.;.y/iN xviB h^fHD If sou. | »t 



Student Perfornance items similar to 

FT2, Unit 1, Subtest i, ^12 FT2, Unit 1, Subtest 2, #10 FTl, Unit 4, Subtest 1, #7 



[■.■3 li!^D b:2":J EED 

«•*'»»'», «Y* 

ft * » • 4 ' I •. '»o*. **fin 



ERIC 



^2 l> - Tj^ 



.H'^ <b:i Pi|R tf;i rfi{\ v'v HC :^jict; ^tst Ki: rsNt ♦4'>i 



18 




TAB! S 3 

Distribution of Typo and Level of Items in the CD/PS Test of Developmental Level 



Coanitive Devpln 


pment Items: 


Developmental 


Item Type 


Level of Item* 


Transformation 


Seriation 


Proportion 


Exclusion 


Combination 


CI 


1, 20 


3 


8 


10, 17 


5 


C2 






4 




9 


PI 




15 


14 




11 



*C1 =5 Concrete 1, beginning inconsistent concrete operations 
C2 = Concrete 2, established consistent concrete operations 
Fl = Formal 1, a beginning level of formal operations 



Problem Solving Items: 


Problem Solving Skill 


Item Type 




Exclusion 


Knowing the question to be answered 


7, 12 


Knowing the experimental condition 


2, 6 


Recognizing conditions which might 
influence the results of an 
experiment * 


13; 18 


Interpreting the results of an experiment 


16, 19 


Recognizing appropriate conclusions* 


10, 17 



*Rocategorization of the two cognitive development 
exclusion type items* 
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TABLB 4 

Cognitive Development Subtests: Descrix^tions and Statistics 

Suriation/Conseirvatioii : This subtest includes simple forms of the following types 
of tasks that are basic to the concrete operational stage of cognitive development. 



Problem Type 



Item Percentage Correct 
FTl FT2 
(N=162) (N=260) 



Desc ription 



Seriation: 



Combination: 



73% 



80% 



Proportion/ 
Exclusions 



83% 



77% 



Transformation ; 



20 



79% 



77% Number each of six forks in 

order from smallest to largest. 

79% Decide how many days are 

needed to^ try out five fishing 
poles at the rate of one a 
day, 

82% Out of a group of four boys 

of different heights with 
different length fishing poles 
(ordered in the same direction 
as height), identify the second 
shortest boy with the second 
shortest pole, 

78% Out of a group of four men 

with different amounts of 
money and different sized cars 
(ordered in inverse relation 
to amount of money) , identify 
the man who ovms the smallest 
car and is the richest man* 

67% After one bottle of root beer 

is poured in a tall skinny 
glass and another bottle of 
root beor is poured in a short 
fat glass, decide whether the 
tall or short glass has more in 
it or whether they both have the 
same amount. 



69% 



66% After a test tube is filled 

with water and emptied into a 
beaker and then the test tube 
is refilled vvith water, decide 
whether hbey both have the same 
amount of water or whether the 
beaker or test tube has more. 
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Fox'mal Oporat:ions: This subtest includes the following soriation, proportion, and 
combination problems which require abstract thinking involving mentally sorting or 
manipulating numbers and groups in a systematic fashion. 



Problem Type 



Seriationj 



Item 



15 



Percentage Correct 

FTl FT2 
(N=^162) (N=260) 



37% 



Description 



31% Given calendars for October and 

November and the information 
that a boy planted a flower on 
October 23 and measured it three 
weeks later, determine what the 
date was three weeks later when 
he measured it. 



Proportion: 



14 



14% 



14% Presented with pictures of 

three groups of children 
playing ball, Group A made up 
of 5 children and 1 ball, 
Group B made up of 6 children 
and 3 balls, decide which group 
to join if one wished to catch 
the ball most often. 



Combination: 



11 



10% 



13% Given that each of four girls 

will play every other girl to 
find the best player, determine 
how many games must be played 
in all • 



9 8% 15% Given that a baseball manager 

has three pitchers and two 
catchers and wants to find the 
best pair, decide how many pairs 
must be formed to give each 
pitcher and each catcher an 
equal chance. 

The following prerequisite relationships hold for cognitive developmental items 
(at the 10% tolerance level); 



Item Difficulty 
82% 80% 77% 73% 



70^ 



66% 



26% 



13% 11% 



->20 



->1 



->14-^1 
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Subtest Statistics; 



Set lation/Consoryation Formal Oporations 







FTl 


FT2 




FTl 


FT 2 






{N-162) 


(N-260) 




(N^1G2) 




Maximum Possible Score: 




13 


13 




8 


8 


Range of Scores: 




0-13 


0-13 




0-6 


0-8 


Mean : 




9,2 


9.1 




1.4 


1.5 


Standard Doviationt 




3.1 


3.3 




1.4 


1.8 


Hoyt Reliability: 




.61 


.64 




• 01 


.38 


Standard Error of Measurement: 


1.8 


l.P 




1.2 


1,2 


r biserial correlation 


with 












subtest score 


Item 






Item 








8 


.91 


.87 


15 


.01 


.83 




5 


.96 


.87 


14 


.81 


.91 




4 


• 40 


.55 


11 


.67 


.84 




20 


.80 


.79 


9 


.74 


.96 




3 


.64 


.74 










1 


• 90 


.89 








Percentage answering 














the following number 














of items correctly: 


None 


.6% 


2% 


None 


45% 


51% 




1-2 


13% 


11% 


1 


44% 


31% 






17% 


27% 


2 


10% 


13% 




5-6 


69% 


61% 


3-4 


1% 


5% 
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TA13LK 5 



Probleni Solving Subtests: Description and Statistics 



PS 1: This subtest consists of six exclusion type tasks classified at the concrete 
operational stayo oC co'jnitivG development, Tlie items are the same as those used 
during the first year of study of this population, Thoy deal with tho following 
three aspects of problem solving: 



Probleia 



I tejn Porcentage Correct 
FTl FT 2 

(N=162) (N=260) 



Description 



Knowing the 
Question to be 
Answered: 



76% 



66% Given corn seeds planted in two 

pots of good soil, watered the 
same, having plenty of fresh 
air, with one pot placed in a 
window and tho other in a dark 
closet, identify what the per- 
son is trying to find out: Do 
plants need water or sand or 
light or air to grow. 



12 



63% 



60% Given wheat seeds planted in two 

pots of good soil, watered the 
same and placed near a window, 
v;ith one plant scaled tightly 
in a clear jar, identify what 
the person is trying to find 
out: Do plants jioed good soil 
or water or light or air to grow 



Knowing the 

Experimental 

Condition: 



57% 



541 



Given four identical tablets of 
]::astor ogg dye dropped at the 
same time into four same sliced 
jars full of wat.er and loft 
for to!i n\itcMT , explain why tho 

(;Lor S| jr<.'<3.i (ii fl'r r' nt ari^>uiiL5»: 
bocausf.' tliorr^ v;er^' diffoi<.?nt 
imou i\ t s f w a t o r , ino r e c o I ^ ; r [: u t 
in one jar^ v,-at<.M; in each Jar wa: 
a different turiporaLuro or 
different kinds of tablets were 
used * 



6 eO% 75% Given the conditions described 

in item 7 above, identify the 
thing that v;as t\ot the same for 
both pots of plants: air, soil, 
v;ater, light. 



21 



Rococjriixiiuj 
Conditions Which 
Miijlit Influence 
the Results of 
an Experiment I 



13 



70% 



65% Given the conditions described 

in item 12 above, after a few 
weeks the plants in the sealed 
jar wore short and yellow but 
tliose in the open pot were tall 
and green • What might explain 
tliesc results: The clear glass 
made the loaves get yellow; the 
plants in the jar couldn't got 
enough air/ tlie plants in the jar 
couldn't get enough light; it was 
too hot near the window. 



18 



49% 



38% In order to find out whether 

plants can grow better in the 
dark or in the light, a person 
put a pot with radish seeds in 
a dark room and a pot with bean 
seeds in the light and watered 
the pots the same. The bean 
seeds grew better than the 
radish seeds so the person said 
plants grow best in the light* 
To be able to say this, the 
person should have: watered 
both plants more; watered the 
radish seeds more; put the same 
kind of seeds in both pots; or 
grown the seeds in water instead 
of soil. 



PS 2: This sulDtest consists of four exclusion type tasks classified at the 
concrete operational stage of cognitive development. Those items deal with 
inferential relationships involving making judgmcnhs ':ibout the appropriateness of 
various conclusions drawn from a stated set of conditions. 



Problem 



1 ion 



Interpreting 
Results of an 
Experiment : 



16 



72% 



GO :. Cjiv c n a ] vL c s stored i n a 

rcif rigerator and on a window- 
sill and changes observed over 
two weeks, conclude that apples 
rotted faster in the warm window- 
sill. 



19 



56^ 



53% Givfin weight gain in a plant 

witli no change in the weight 
of soil in the pot, conclude 
that the plant grew bigger 
without using up soil. 
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Kococjni,/incj 
ConclusioiiK ; 



10 



56% 



53% Given that Karen weicjhs loss 

than Joan and Joan woicjhs less 
than ilulen, select conclusion 
that Karen weighs loss than 
llolcn. 



17 



>7^ 



53% Given tliat Mary is shorter than 

Ann, Ann is shorter than Susan , 
and Susan is shorter thaji Kathy, 
select conclusion that Mary is 
shorter than Kathy, 



The following prerequisite relationships hold among the problera solving items (at 
the 10% tolerance level) : 



Item Difficulty: 
76% 69^0 67% 



63%61% 



56% 



52% 



39% 



13- 



6^5^^:=—--^ 7 




The prerequisite relationships between problem solving and cognitive developmental 
items are integral and direct. Item 5 is a prerequisite for each of the problem 
solving items except item 18 which is linked to item 4. All of the problem solving 
items are prerequisites for item 15 except items 6, 13, and 18 which are prerequisites 
for item 14. 



Analysis of Prerequisite Relationships Among Cognitive Development and Problem 
Solving Items (at the 10 i tolerance level) 

Item Difficulty: 

82% 77% 70% 66^ 52% 26% 13^11-. 

I.... I t-.^l I I , I ' 
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Subtest Statistics! 



PS 1 







FTi 


FT2 




FTI 


FT 2 






(H=1G2) 


(N=2G0) 




(N = 162) 


(N=260) 


Maximum Possible Score i 




12 


12 




8 


n 


Range of Scores: 




0-12 


0-12 




0-8 


0-8 


Mean: 




7.9 


7.2 




4.8 


4. .4 


Standard Deviations 




3.4 


3.4 




2.3 


2.3 


Hoyt Relialjility: 




.66 


.62 




.37 


.30 


Standard Error of Monsuro: 




1.8 


1.9 




1.6 


i.o 


r Biscrial Correlation 














with Subtest Score: 


Item 






Item 








7 


.91 


.89 


"16 


.73 


.69 




12 


.91 


.80 


19 


.77 


.68 




2 


.72 


.68 


10 




.67 




6 


.87 


.13 3 


17 


.74 


.81 




13 


.83 


.77 










18 


.60 


.59 








Percentage answering the 














following number of 














itejas correctly: 


Hone 


1% 


S% 


None 


6% 


6% 




1-2 


19% 


22% 


1 


14% 


23% 




3-4 


34% 


37% 


2 


31% 


31% 




5-6 


46% 


351. 


3-4 


48% 


40% 
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TABLL-; 6 



Teacher Ratings of Students t Definitions and Statistics 



Teachers wore asked to rate students in their field test class on six characteristics 
felt to have relationships with successful perforuiance on ME AND MY ENVIRONMENT. The 
task required about an hour and each rating was made on a separate sheet on which 
were placed the following descripcions of categories: 



Ratin<j 



Following 
Directions : 



Percentago per Category Def ini tion 



(Low) 





FTl 


FT2 




(N-157} 


{N==247} 


1 


9% 


17% 


2 


15% 


21% 


3 


29% 


29% 


4 


29% 


20% 


5 


18% 


13% 



Rate each child's ability to follow 
directions on a scale of 1 to 5. 
The higher the number, the more 
able the child is in carrying out 
a task or sequence of tasks with 
little supervision. Think of how 
much help each requires, how many 
times the directions must be 
given/ and liow detailed an 
explanation is necessary. Note 
that this rating involves both 
understanding the directions and 
staying with the task to do what 
was directed. 



Working With 


(Low) 


1 


4% 


8% 


a Group; 




2 


13% 


20% 






3 


22% 


19% 






4 


27% 


3 0% 




(High) 


5 


33% 


21% 


Ability to Work 


(Low) 


1 


6% 


6% 


With Hands: 




2 


9% 


11% 






3 


23% 


24% 






4 


29% 


28% 




(High) 


5 


32% 


30% 


Child's Awareness 




1 


13% 


r 11% 


of What is Going 




2 


2 5% 


2 6% 


on Around Him: 




3 


3% 


2% 






4 


30% 


37% 






5 


27% 


22% 
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Rate each child's ability to 
work with others in a group 
situation on a scale of 1 to 5. 
The higher the number, the more 
able the child is in getting along 
and cooperating with others in 
doing a task. This is a rating 
of social adjustment in a work 
situation. 

Rate each child's ability to work 
with his hands and manipulate 
things on a scale of 1 to 5. 
This rating includes coordinatior^/ 
manual dexterity, large and small 
muscle control. The higher the 
number, the more able the child is 
to work with his hands. 

Rate each cliild's awareness on a 
scale of 1 to 5. The higher the 
number, the more wise/aware the 
child. 

INNOCENT/UNAWARE: Doesn't see 
below the surface of things; 
usually takes things at face 
value; is trusting, gullible. 
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Rating. 



Percenta<gQ Por Catocjory pof inltion 
FTl FT2 



This child is unaware of much 
that is happening around him* 
He has no doptli of understanding. 

WISE/ AWARE J Wise to the ways of 
the streets and of people; knows 
his way around. This child is 
somewhat sophisticated and aware 
of subtleties in what is happening 
around him. 

NOTE: Do not use category 3 
unless absolutely necessary* 
A "3" rating will bo interpreted 
to mean that you are uncertain 
how to rate this student. Cate- 
gory 2 indicates a degree of 
innocence and unawareness not as 
extreme as Category 1. Category 
4 indicates a degree of wisenoss 
and awareness but not as extreme 
as Category 5. 

AVOIDS LEARNING: The student 
disregards or tries to undermine 
the intent of class activities. 
School is a game or battle with 
the teacher. The student might 
be uncooperative or disruptive, 

7% 10% OUT OF IT: The student is 

inattentive and a nonparticipant * 
He simply is not aware of much 
that is going on. 

80% 76% TRIES TO LEARN: The student is 

cooperative and willing; does his 
best and participates in class 
activities. 

TRUE P'^TARDATE: While the cause, 
may not be known, the child is 
of low IQ and lacking in intellec- 
tual abilities; the child is 
mentally defective, slow-witted. 

8% 9% EMOTIONALLY DISTURBED: The child 

for whatever reason exhibitis 
extremely neurotic or psychotic 
behavior. This includes extreme 
withdrawal as well ^ anxiety, 
uncontrolled rages and the 
repetitive behaviors of the 
schizophrenic. 



Attitude and 13% 13% 

Approach to 
School: 



Primary Reason 59% 60% 

for Placement 
in Your Class: 
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Rating Porcentago Per Categor y Definition 

FTl FT2 



19% 18% DISADVANTAGED: The child who has 

a history of severe deprivation — 
of food/ experience, stimulation, 
emotional support* Children from 
economically deprived settings, 
in free lunch programs, or whoso 
family is on welfare sometimes 
fit this category, 

11% 11% OTHER; The child may be placed 

in your class simply because no 
one else in the building can handle 
him. This catch-all category 
includes; the epileptic, physi- 
cally handicapped (deaf, partially 
sighted, sickly) , discipline 
problem, hyperactive, speech 
defective, and child with learning 
disabilities due to perceptual 
and psychomotor problems. Please 
give us a brief label if you 
check this as the basic reason for 
placement. 
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TAIil ■ , 7 



Field Toy I I Stnidcnt PerformancG: DoscripLiori and Statistics 

Unit 2: This subtest contains five multiplc-choico items and a teacher rating of 
performance, Tlio following two areas of understanding arc tisiioKscd: 



Area 



1 torn Porcentago Correct 
(U=112) 



Description 



Microbe Needs 



74% 



Rocognisie at least one of the two 
reasons given thiat microbes like 
yous you give them warmth to 
grow I and you provide them a 
source of food and water. 



66H3 



81% 



Microbe Fighters 4 



90% 



7 7^o 



82^ 



Recognize that the explanation 
for microbes growing in one of 
two bottles of agar sealed with 
a bent tube may be that the 
bottle with microbes was not 
boiled or a microbe fighter was 
put in tlio other bottle. 

Successfully complete a poster 
on "How to Control Microbes" 
ijicluding illustrations repre- 
senting three or more of the 
categories: soap and water, 
cleansers or disinfectants, 
boiling water, covered food, 
covered mouth when snee?.ing; or 
a part on "Places That Microbes 
Live" including three or more 
of the categories: people, air, 
water, school, food, other 
reasonable places. 

Recognize that the best thing 
to do if you think you have VD 
is to go to a liealth clinic. 

Identify at least three of the 
following as microbe fighters: 
mouthwash , soap, toothpaste , 
iodine, rubbing alcohol, 

Recogni^:e as false at least 
three out of four conunon mis- 
understandings about VD, and 
identify as true at least three 
out of four accurate statements 
about VD. 
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Unit 4, SubLoHL 1: 'riiia 53ubtest coiitains nine items asJsessing the following 
lUiderst.andinijs ; 



Area 



I bom Percontage Correct Oob3cription 
(N-101) 



Food Chains 



77% 



Supply the word Snake and Grain 
in the chain Hawk- -Mouse- 



94% 



Supply the word Grass or Grain 
in the chain Steer- • 



69% 



Supply the words Chicken and 
Insects or Worms for the chain 
Lion- - -Grass, 



4 89% Interpret pictures to state 

that energy from grass can get 
to a chicken through a cater- 
pillar • 

5 61% Liiterpret pictures to state 

that energy from i person can 
reach a cat by passing through 
a fly and a fish. 

G 62% Interpret pictures to draw a 

food chain linking six animals 
to a plant. 

Food Webs 7 77% Recognize that a picture of a 

food web shows that everything 
depends upon plants. 

B 29% Associate the term "food web" 

with a picture of a food web. 

9 54% Given a park pond web in which 

fish eat mosquitos and birds eat 
fish^ if tlie pond is sprayed to 
Kill tlie mosquitos^ choose the 
conclusion that fewer fish 
eating birds will come to the 
pond. 

Unit 4, Subtest 2: This subtest contains eleven multiple choice items assessing 
tlie follov/ing areas: 



Area 



I tem Percentage Correct De scripti on 
{N=58) 



Microbe Growth 



100% 



Select the refrigerator a? the 
best place to keep milk so it 
won ' t spoil. 
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62% 



Given bread in four coinbinations 
of moisture and ton^porature, 
select "wot and v/arm" broad as 
tliat wliich would mold fastest. 



84% 



Choose an unwrapped sandwich 
as the place where microbes 
would grow easily. 



78? 



74% 



Identify the correct diagram 
that represents a cycle. 

Shown a corked flask of grape 
juice witli a tube running into 
a test tube of BTB solution, 
select the response that this 
equipment could be used to 
show that microbes can breath. 



95% 



Identify which of two pictured 
loaves of bread was made with- 
out yeast. 



Decomposition 



71% 



78% 



Conclude from the breadniaking 
with and without yeast that 
some microbes help us. 

Select a mocassin as the thing 
tliat will decompose most easily 
of a pictured group of objects. 



84% 



10 



52% 



Select at least four out of 
seven correct statements as 
answering why garbage is a 
problem. 

Choose the word "helpful" as 
best describing microbes that 
eat garbage. 



11 



66% 



From pictures of bottles being 
thrown in a garbage can, being 
taken to a market^ being broken, 
and being thrown out of cars, 
choose taking them to a market 
as doing the best thing for our 
environment. 



ERIC 



23-b 



Subtest Statistics: 



Maximum Possible Score: 
Ranye of Scores : 
Mean; "* 

Standard Deviation: 

lloyt Reliability: 

Standard Error of Measurement: 

4 Biserial Correlation 

with Subtest Score: Item 



U nit 2 Unit 4, Subtest 1 

(N=112) " (N«101) 

30 16 

6-30 2-16 

21.7 10.3 

5.3 3.9 

.50 .40 

3.5 2.8 



Itom 



Unit A, S ubtest 2 
(N==58) 

13 
4-13 
9.9 
2.3 
.48 
1.6 



Item 



1 
2 
3 
4 
5 
6 



.30 
.26 
.81 
.90 
.35 
.32 



1 
2 
3 
4 
5 
6 
7 
8 
9 



.49 
.59 
.59 
.63 
.77 
.42 
.85 
■.JO 
.99 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 



.47 
.23 
.54 
.80 
.78 
.71 
.74 
.43 
.54 
.65 



Unit 2 
(N=112) 

Perccntiiye answering 
the following num- 
ber of items 
correctly: 

Hone 0 
1-3 13% 
4 23% 
5-6 64% 



Unit 4, Svxljtest 1 Unit 4, Subtest 2 

{N=101) (N=58) 



0-2 


9% 


0-? 


3% 


3-5 


32% 


3- / 


10% 


7-8 


58% 


8-9 




9 


1% 


10-11 


62% 



r 



23-c 
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Field Test 2 Student Porfornaiicc : l^escription and Statistics 

Unit 1, Subtest 1: Tliifi subtest contains multiplo clioice itonis requiring some 
ability to cateyorizo or group and deal with the following areas: 



Area 



1 tern P 0 r ce n t ago Co r r e c t 
{N=:144) 



D escription 



Senses : 



7 8^. 



Lnvironmental 
Components : 



2 
3 
4 

6 
7 
8 
9 



60% 
67% 
65^ 
69% 
75% 
59% 
76^^ 
58% 



Identify the ear as the sense 
that v;ould tell if all of the 
following jvere in the environ- 
ment: fire siren, train 
whistle, jet airplane, rock 
rausic/ sea shore. 

Kecogni5?e as part o£ the 

environment : 

smoke 

music 

garbage 

flowers 

peop^lG 

clouds 

smells 

ants 



Temperature : 



10 



67% 



Recycle : 



Life Needs: 



Recognize which sot of 
temperature records wore taken 
outdoors rather than in the 
classroom. 



11 69% r<ocogni2e an appropriate 

definition of the v;ord 
"recycle". 

12 91% Identify at least three of the 

following as things you could 
not live without: air, food, 
water, friends, shelter. 

Unit 1, Subtest 2: This subtest contains ten items, eights of which represent 
performance tasks and the remainder multiple choice items. The items assess the 
following competencies; 



Area 



I tern Percent age Correct 
(N=143) 



Description 



Measurement; 



89% 



62% 



Take water temperature reading 
within 2^ accuracy* 

Use 12 inch ruler to measure 
3 1/2^' length within 1/4*' 
accuracy. 



24 



3 



Usa 12 inch rulor to measure 
IB'* length witliin 1/4" accuracy. 



Spatial 
Orientation : 



Given north, correctly identify 
all other compass directions. 



70% 



Locate the intersection of two 
streets on a map. 



6 87% Correctly identify the left side 

of a worksheet. 

7 65% Infer compass directions in a 

picture using cues of time of 
day and position of shadows. 

Grouping: 8 90% Correctly sort ten pictures into 

plant and animal groups. 

9 58% Indicate some understanding of 

what happened in a classroom 
experience dealing with the 
categories living/nonliving. 

10 69% Choose the appropriate labels 

for two sets of pictures 
representing the categories 
living/nonliving. 

Unit 2: This subtest contains five multiple-choice items ajid a teacher rating of 
performance. Tlie following two areas of understanding are assessed: 



Area 



Microbe Needs i 



I tern Percentage Correct 
{N=-180) 

1 79% 



Description 



Recognize at least one of the 
two reasons given that microbes 
like you: You give them warmth 
to grow, and you provide them 
with a source of food and water. 



63% 



Recognir.e that the explanation 
for microbes growing in one of 
two bottles of agar sealed with 
a bent tube may be that the 
bottle with microbes was not 
boiled or a microbe fighter was 
put in the other bottle. 



71% 



24-a 



Successfully complete a poster 
on "How to Control Microbes*' 
including illustrations reprc" 
senting t}\rce or more of the 
categories: soap and water, 
cleaners or didinf ectants , 
boiling water, covered food, 
covered mouth when sneezing; 



Microbe Ficjhtoi's 
and VD 



92% 



or a poster on "Places that 
Microbes Live" Includincj throe 
or more of tJie catcgorios; 
j^eoplo, air, water, scliool, 
food, other reasonable places. 

Recocjnizo that the best thinq 
to do if you think you have VD 
is to go to a health clinic. 



85% 



77% 



Identify at least three of the 
following as microbe fighters: 
mouthwash, soap, toothpaste , 
iodine, rubbing alcohol. 

Recognize as false at least 
three out of four common 
misunderstandings about VD, 
and identify as true at least 
three out of four accurate 
statements about VD. 



Subtest Statistics for Field Test 2; 





Unit 


1, Subtest 


1 Unit 


1, Subtest 2 


Unit 2 






{N=^144) 




(N^143) 




(N=180) 


Maximum Possible Score: 




24 




50 




30 


Range of Scores: 




3-24 




5-50 




0-30 


Mean: 




16. 6 




35.1 




21.7 


Standard Deviation: 




4.7 




10.4 




6 


Hoyt Reliability: 




.48 




.65 




.64 


Standard Error of Measurements 




3.3 




5.9 




3.3 


r Biserial Correlation with 














Subtest Score: 


Item 




I tern 




1 tern 






1 


.52 


1 


.65 


1 


.70 




2 


.52 


2 


.74 


2 


.65 




3 


.56 


3 


.67 


3 


.67 




4 


.64 


4 


.74 


4 


.85 




5 


.61 


5 


.76 


5 


• 40 




6 


.52 


6 


.76 


6 


.62 




7 


.70 


7 


.74 








B 


.52 


8 


.57 








9 


• 59 


9 


.52 








10 


.62 


10 


.56 








11 


.76 












12 


.30 










Percentage answering the 














following number of 














items correctly: 


None 


0 


None 


0 


None 


1% 




1-3 


17% 


1-4 


10% 


1-3 


14% 




4-8 


27% 


5-7 


43% 


4 


47% 




9-12 


56% 


8-10 


47% 


5*-6 


38% 
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